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Abstract. It is demonstrated that improved entrainment control of chaotic 
systems can maintain periodic goal dynamics near unstable periodic orbits 
without feedback. The method is based on the optimization of goal trajec- 
tories and leads to small open-loop control forces. 



1. Introduction 

In recent years, a large number of investigations has been made into the 
control of chaotic dynamics, and many techniques have been applied in 
simulations and experiments (see, for instance, [1] for an overview). 

Two techniques have been proposed for an open-loop control of chaos. 
The first approach is related to vibrational methods, as a scalar periodic 
perturbation is applied to the chaotic system. Usually, the control signals 
are sinusoidal [2] or two- mode forces [3]. Recently it has been shown that 
the method can be improved by use of optimized multimode signals which 
are more complex [4]. 

The second method uses equations of motion and a specific goal dy- 
namics to derive vector control forces. If the goal trajectory is suitably 
chosen, the chaotic system under control converges to the goal. Therefore, 
this method is often referred to as entrainment control [5]. In this paper it 
is shown how entrainment control can be improved with respect to small 
control forces. For this purpose, a specific property of chaotic systems is 
exploited: dense unstable periodic orbits (UPOs). 
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In fact, UPOs are common goal orbits of most feedback techniques em- 
ployed for control of chaos (see, e.g., [6]). Because a UPO is a natural, but 
unstable motion of the system, control forces have to be applied only for 
transfer to and stabilization of the orbit. In the ideal (noiseless) case, the 
stabilization forces tend to zero once the UPO is actually reached. There- 
fore, feedback control of UPOs can be maintained with very small forces in 
low noise systems. Despite the power of such methods, however, there are 
situations where one wants to or has to dispense with a feedback from the 
system. Then, open-loop techniques are needed. 

While there exists a theory for open-loop stabilization of unstable fixed 
points (vibrational control, see [7]), a counterpart for stabilization of unsta- 
ble periodic orbits is still lacking to the author's knowledge. Although it is 
supposed that the scalar periodic perturbation methods mentioned above 
usually stabilize periodic dynamics in the vicinity of UPOs, this has not 
been shown yet explicitly. The underlying mechanism, possibly some reso- 
nance phenomenon, as well as the exact final dynamics are still unknown. 
This is different for entrainment control, where the appropriate dynamics 
is given a priori, and which is described in the following. 

2. Entrainment control 

We start with a nonlinear dynamical system in the continuous time domain, 
which is influenced by a control signal vector. The equations of motion are 
supposed to be known, according to the ordinary differential equation 



with the system state x in the state space IR™, the control vector u in the 
control signal space IR S and the vector field f : IR n x IR S — > M n . Let z be 
a goal dynamics generated by a vector field g, z(t) = g(z(i)), z(t ) = z . To 
introduce the goal dynamics as solutions of Eq. (1), we have to apply forces 
u(t) which solve the equation 



Thus, the vector field f is simply changed to g by the control forces. To do 
this, however, feedback from the system is necessary, as the actual system 
state x(t) appears in Eq. (2). The main point of the entrainment control 
method is to eliminate x(i) by the assumption that the system is already 
located in the initial goal state zo when the control is started at to- If so, 
the correct control signal u(i) is given by the solution of the equation 



dx(t) 
alt 



x(*) = f(x(t),u(t)) 



(1) 



x(t) = f(x(t),u(t))=g(x(t)). 



(2) 



f(z(*),u(t))=g(z(t))=z(t). 



(3) 



ENTRAINMENT CONTROL OF CHAOS NEAR UPOS 



3 



Equation (3) can be solved without any system state measurement; in fact, 
not even a generating vector field g has to be given: it is sufficient to know 
the goal trajectory itself and its time derivative (velocity) for the control 
time interval, {z(i),z(i)} t6 [ t0)tl] . 

There are several conditions that have to be fulfilled to make the en- 
trainment control scheme work. First of all, Eq. (3) has to be solvable for 
u(t). This is trivially true for simple vector additive forces: 

f(z(t),u(t))=f(z(t)) + u(t) u(t) = z(t)-f(z(t)) (4) 

We restrict our discussion to such forces, which are the most common in 
the literature on entrainment control. However, problems immediately arise 
if, e.g., the control space dimension s is less than the state space dimension 
n (a treatment of general control influence with s=d can be found in [8]). 

The next condition to be satisfied is asymptotic stability of the goal 
trajectory. While control forces according to Eq. (3) ensure that the goal 
trajectory is a solution of the controlled system Eq. (f), there is no state- 
ment about whether nearby located system states are attracted by it - in 
other words, whether entrainment occurs in a vicinity of z(i) according to 
lim^oo |x(i) — z(t) \ = 0. Even if this is the case, one needs a large basin 
of attraction (ideally the whole phase space) to make the method work for 
a large set of possible initial states distant from z(i). Statements about 
basins are very hard to find (compare [9] ) , but a discussion of stability can 
more easily be made. For simple vector additive control, Eq. (4), we call all 
points in phase space where all eigenvalues of the Jacobian of f have nega- 
tive real part, convergent regions (see also [8, 9]). Goal trajectories entirely 
located in convergent regions turn out to be asymptotically stable, if their 
time derivative z(t) is sufficiently bounded. 

3. Optimization of the goal trajectory 

Because of the stated stability aspects, goal trajectories are usually chosen 
to be located in convergent regions. This results in a typical drawback of the 
method: Due to very little overlap of convergent regions and unperturbed 
chaotic attractor, such a goal dynamics is quite different to the natural 
system dynamics. Consequently, the system is strongly altered by control, 
and control forces are large. In fact, they have to be of about the magnitude 
of the velocities appearing in the uncontrolled system in order to pull the 
movement into convergent regions. 

To attack this problem, one has to realize that location in convergent 
regions is not a necessary condition for stability of a goal trajectory. The 
resulting dynamics of chaotic systems controlled by periodic perturbation 
methods indeed suggest that stable dynamics can also be achieved in the 
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chaotic attractor region, especially near a UPO. Control forces are smaller 
then, as the natural dynamics is only slightly altered. An extreme case 
would be to consider a UPO itself as a goal for entrainment control: we get 
zero control forces according to Eq. (3). However, such a goal is of course 
unstable. It has to be at least slightly changed to result in a stable one. To 
this end, a family of deformations of a UPO is considered in the following. 

Let z UPO (t) denote a known UPO of the chaotic system with period 
T=2tt/uj. We chose a finite Fourier series as a deformation Az(t), and also 
include a linear time transformation by a factor rj. The family of goal tra- 
jectories now reads 



<t) = z UPO (^) + Az(^) 

M 

= z UPO (rjt) + ^2 cos(mu:r)t) + h m sva.{mujr]t)) . (5) 

771=0 

It is parametrized by r\ € Hi and the Fourier coefficient vectors a m , b m G 
IR™. Since b° has no effect on z(i), a deformation (or a goal) is characterized 
by a total of d = (2M+l)n + 1 real numbers. 

Now, we formulate the determination of advantageous deformation pa- 
rameters that lead to a stable goal trajectory with small control forces as 
an optimization problem. A real number according to a cost function is 
assigned to each probed set of parameters. The cost assesses the stability 
of the chosen goal trajectory (which is determined numerically) as well as 
the magnitude of the resulting control forces: 

rnQf _ / ll u (*)IUas + 7[exp(/i) - 1] : n < 1, , , 

" \ \\u(t)\\ max + 7 [exp(/i) - 1] + C : fi > 1 

Here, jj, = maxj{|/jj|} is the maximum absolute value of the characteristic 
(Floquet) multipliers of the goal orbit. These are well defined, as the goal is 
periodic, and they are calculated by integration of the variational equations 
[10]. Instability is indicated by /i > 1 and causes high cost via a large 
positive penalty term C. The cost function further includes an exp(//) and 
the maximum norm of the resulting forces. The weight of stability with 
respect to magnitude of forces can be adjusted by 7. The global minimum 
of the cost function in the deformation parameter space corresponds to the 
best goal trajectory in sense of the chosen balance between stability and 
small forces. 

For various reasons, a direct analytic treatment of the given optimiza- 
tion problem is usually not possible: the UPO is not known in analytic 
form, a direct expression for stability of a deformed UPO is missing (the 
variational equations have to be integrated), and the cost function is not 
continuous. Consequently, numerical methods are employed. The UPO is 
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represented by a periodic cubic spline interpolation, and /i is calculated via 
numerical integration of the variational equations. The optimization is done 
by a numerical technique that can handle high-dimensional problems with 
rough and rapidly varying cost functions. For this purpose, the stochasti- 
cally guided algorithm amebsa from [11] was chosen; this is a combination 
of simulated annealing and the downhill simplex method. 





Figure 1. (a): Chaotic attractor of the Lorenz system (a — 10.0, r — 75.0, b — 0.4). (b): 
Embedded unstable periodic orbit (UPO, interrupted line) and the optimized deformation 
of it that turns out to be a globally stable goal trajectory (SPO, solid line). 
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Figure 2. (a): Orbit in phase space of the difference vector Az between the UPO of 
the Lorenz system and the optimized stable goal trajectory (SPO). (b): Path of the 
corresponding vector control forces in the control signal space. 

4. Example 

In this section, the control of a chaotic Lorenz system is demonstrated. The 
equations with vector additive control read 

±i = cr(x 2 - x\) + u±(t), ±2 = rxi - x 2 - X1X3 + u 2 (t), 

X3 = x 1 x 2 -bx 3 + u 3 (t), (7) 

where time dependence of the forces is explicitly written. A given periodic 
goal trajectory {z(t), z(t)} tg [ ,T] yields control forces according to Eq. (4). 
Parameters of the Lorenz system are set to a = 10, r = 75, and b = 0.4. The 
resulting chaotic attractor is shown in Fig. 1(a). An embedded UPO which 
corresponds to z UPO in Eq. (5) is given in Fig. 1(b) by the interrupted line. 

The deformation is defined by five Fourier modes (M=5) which leads 
to a 34-dimensional search space for optimization; 7 is set to 5, C to 100 in 



ENTRAINMENT CONTROL OF CHAOS NEAR UPOS 



7 



Eq. (6). The best result of several optimization runs is shown in Fig. 1(b) by 
the solid line. It is a stable goal trajectory and therefore a stable periodic 
orbit (SPO) of the controlled system. The actual values of deformation 
parameters can be found in Tab. 1 together with additional data of the 
UPO and the SPO. The deformation lies in the range of some percent, and 
it is plotted in Fig. 2(a). The resulting forces, shown in Fig. 2(b), change 
the vector field of the chaotic system less than about 10%. This is an 
improvement of more than a magnitude if compared to goals in convergent 
regions [9]. 

Numerical tests indicated that the SPO is globally asymptotically sta- 
ble; the basin is the whole phase space. However, transient times until con- 
trol is established depend strongly on the initial state, and range from just a 
few up to a few hundred control periods. A typical behavior is presented in 
Fig. 3. After control is turned on, an intermittent transient appears. Finally, 
the system settles down on the desired goal orbit, which is maintained. 




50 100 150 200 250 300 350 

t 



Figure 3. Controlled Lorenz system, first coordinate xi(t): Control is turned on at 
to = 100, and the goal trajectory is reached after transients at about t — 250 (after 
approximately 75 control periods). 

5. Conclusion 

It has been shown how open-loop entrainment control in the vicinity of 
unstable periodic orbits can be realized. The search for suitable goal tra- 
jectories has been formulated in terms of an optimization problem with 
respect to UPO deformations. Feasibility has been demonstrated in an ex- 
ample, where a chaotic Lorenz system has been successfully controlled to 
an optimized distortion of a UPO. The locations of such goal orbits are 
independent of convergent regions, and thus the required forces are small 
compared to hitherto used goal dynamics far from the chaotic attractor. 

This work was supported by the Deutsche Forschungsgemeinschaft 
(Sonderforschungsbereich 185). 
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TABLE 1. Coordinates 21,2,3 give a point of the original UPO of the Lorenz system, 
T its period. Maximum absolute values of the Floquet multipliers are given by /1 
for the UPO and for the optimized deformation (SPO). Parameters of the SPO are 
the time transformation coefficient n and Fourier coefficients a™, b™. Subscripts of 
numbers indicate a decimal shift, i.e., 1.234(_2) stands for 1.234 x 1CF 2 . 



21 = 8.0 




22 


= 11.59618 




23 


= 68.87129 


T 


= 2.153957 




f-upo ~ 2.555 




a? 


= -9.794703- 


-2 


aj 


= 2.303546-2 


bl 


= -1.946829- 


1 


V spo = 0.719 






= -1.126072- 


-1 


a 2 


= -4.441229-2 


bl 


= -1.543789- 


1 


t] = 1.001267 




a§ 


= 6.741204_i 




ai 


= -9.082832-2 


bl 


= 5.702340-2 




aj = 1.063004- 


-1 


6? 


= 2.904178-s 




a! 


= 5.343983-2 


bi 


= -9.527600- 


3 


a\ = 1.553288- 


-1 


bl 


= -4.403841- 


2 




= 6.312158-2 


bl 


= -2.940390- 


■2 


a% = -2.747584-1 


bl 


= -7.345061- 


2 


4 


= 9.633147-2 


bl 


= 8.743705-2 




a\ = 2.634346- 


-2 


bi 


= 8.791274-2 




af 


= 2.069052-3 


b\ 


= 1.429860-2 




a\ = 9.267735- 


-2 


b\ 


= 6.849559-2 




a| 


= 2.874568-2 


bl 


= 2.781748-2 




03 = 7.009472. 


-2 


bi 


= 2.443292_2 




a§ 


= -2.478029-2 


bl 


= 3.759263-2 
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